Behavior and stress management recognition apparatus

ABSTRACT

A life support apparatus comprising a vital information sensor attached to a body to acquire vital information of a user, a behavior information sensor attached to the body to acquire behavior information of the user, a situation recognition device which recognizes a user&#39;s situation based on the behavior information acquired by the behavior information sensor and the vital information acquired by the vital information sensor to generate user&#39;s situation information, a data base which stores stress management information are prepared in advance, an information search device which searches the data base for stress management information corresponding to the user&#39;s situation information, and an information presentation device which presents the stress management information obtained by the information search device to the user.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority fromthe prior Japanese Patent Application No. 2000-163793, filed May 31,2000, the entire contents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a wearable type life support apparatusfor measuring and determining various states of a user by using awearable device and giving life support by an information service suchas medical administration or personal navigation according to the user'ssituation, a life support method, and an advertisement providing method.

2. Description of the Related Art

As the society becomes complex, stress in daily life is said to be onefactor of various problems of the modern society because stressadversely affects the health of people by, e.g., causing life-stylerelated diseases such as heart diseases or mental diseases such asdepression, and also triggers crimes.

“Stress” originally means stimuli from the external world (YoshinosukeTadai, “What is Stress?”, Kodansha Bluebacks). Currently, “stress” istaken to also include adaptive reaction against stress. When theadaptive reaction exceeds human limitations, various diseases or mentaldisorders are said to occur. Alternatively, these disorders occurpresumably when the sympathetic nerve and the parasympathetic nervebecome unbalanced due to a change in rhythm of life.

How to cope with stress is important for the people of this day. Thebest measure against stress is stress control, i.e., to eliminatestress. Various methods are recommended to this end: “to see or listento images or music that prompts relaxation”, “to do anything one likes”,and “to shout loudly”.

However, a person who is pressed with business every day is oftenunconscious of the buildup of stress. He/she is heavily fatigued, and inthe worst case, comes to a sudden death. It is therefore important torealize and control stress before it becomes serious or prevent stressfrom building up.

As the importance of measures against stress is recognized, developmentof apparatuses for acquiring vital information of a user and measuringand managing user's stress is an urgent necessity. Several apparatuseshave already been proposed.

However, since a person experiences stress in a variety of situations indaily life, the vital information to be measured largely changesdepending on external situations such as the peripheral environment andthe position of the person as well as internal situations such as actionand mental condition. For this reason, it is difficult to accuratelygrasp user's stress state unless the vital information is analyzed anddetermined in association with user's behavior.

To make the user realize stress, he/she must be notified when orimmediately after stress builds up. Otherwise, the user cannot be awareof stress, and if the user is unaware of the stress, life style and thelike can hardly be improved.

Hence, demand has arisen for the development of a system which candetermine the stress situation in daily life and notify a user of it soas to assist stress control.

For stress control, it is important in terms of care to provide the useran optimum measure to cope with the situation. However, such a techniqueis still absent.

For portable type information communication devices such as handyphones,ringing tones or conversing voice at a public place as in a train posesa problem. To solve this problem, a technique of setting a vibrator callmode as a “manner” mode or receiving a message by an automatic answeringtelephone function is already widely used. However, since urgent contactis sometimes required, a mechanism capable of easily communicating asituation or message without voice communication is required.

In the world of the Internet, advertisement display (banneradvertisement) according to the Internet use situation of a user, suchas Internet advertisement, is widely used. However, informationproviding according to each scene of user's daily life and business thatuses the information providing service for advertisement have not beenrealized yet.

It is an object of the present invention to provide a life supportapparatus and method which can determine the stress situation in dailylife and notify a user of it to cause the user to realize the stress orcan support the user of a method of eliminating stress or care againstthe factor that has caused the stress, on the basis of the situation ofthe user.

BRIEF SUMMARY OF THE INVENTION

The present invention provides a system which can grasp the situation ofa user by various sensors, grasp the degree of stress corresponding toeach situation, and offers a service such as occasional life styleimprovement or relaxation using the concept of a wearable computeralways attached to the user. In addition, the system is applied toconsumer marketing or advertisement display business.

According to a first aspect of the present invention, there is provideda life support apparatus comprising a vital information sensor attachedto a body to acquire vital information of a user, a behavior informationsensor attached to the body to acquire behavior information of the user,a situation recognition device which recognizes a user's situation basedon the behavior information acquired by the behavior information sensorand the vital information acquired by the vital information sensor togenerate user's situation information, a data base which stores stressmanagement information are prepared in advance, an information searchdevice which searches the data base for stress management informationcorresponding to the user's situation information, and an informationpresentation device which presents the stress management informationobtained by the information search device to the user.

According to this arrangement, the vital information and behaviorinformation of the user are acquired, the user's situation is recognizedon the basis of the acquired behavior information, correspondinginformation is obtained from pieces of information for dealing withstress, which are prepared in advance, using the acquired user'ssituation information as a key, and the obtained information ispresented to the user.

The stress situation is determined in daily life, and optimum serviceinformation for stress elimination or care is provided to the user inaccordance with the situation, thereby enabling life advice contributingto user's healthcare.

According to a second aspect of the present invention, there is provideda life support apparatus comprising a user information sensor attachedto a body to acquire information representing a user's situation, asituation recognition device which recognizes the user's situation basedon user information acquired by the user information sensor, atransceiver device which transmits the information of the user'ssituation recognized by the situation recognition device and receiveexternal information transmitted from an external apparatus, and apresentation device which presents the external information received bythe transceiver device to the user, the external information includingan advertisement appropriate for the user, which is sent from theexternal apparatus in correspondence with the user's situationinformation.

According to this arrangement, information representing the physicalsituation of the user is acquired, the user's situation is recognized onthe basis of the acquired information, and advertisement informationcorresponding to the information of the recognized user's situation canbe obtained from the server that hold various kinds of advertisementinformation corresponding to physical situations and presented to theuser.

The stress situation is determined in daily life, optimum serviceinformation for stress elimination or care is provided to the user inaccordance with the situation in consideration of the time andcircumstances, and the user is prompted to use the service, therebyenabling life advice contributing to the commercial effect and user'shealthcare.

According to a third aspect of the present invention, there is provideda life support apparatus comprising various kinds of informationpresentation media for a voice or text message, a user informationsensor attached to a body to acquire user information representing auser's situation, a situation recognition device which recognizes theuser's situation based on user information acquired by the userinformation sensor to generate user's situation information, acommunication device connected to the situation recognition device andcommunicating with external equipment, a situation informationconversion device which selects an optimum message presentation mediumfrom the information presentation media in accordance with the user'ssituation information and convert the situation information into a formcorresponding to the optimum message presentation medium, to presentcall message information sent from the message sender and received bythe communication device to the user, and an answer transmission devicewhich transmits the user's situation information converted by thesituation information conversion device to the message sender.

In this arrangement, upon reception of incoming message informationaddressed to the user, the call message is converted into a form thatuses an appropriate medium corresponding to the user's situationrecognized by the situation recognition device, and presented. Theanswer transmission device transmits the user's situation informationconverted by the situation information conversion device to the messagesender.

The user's current situation is determined in daily life to cope with anincoming call in accordance with the user's situation at that time inconsideration of specific time and circumstances such that the user neednot worry about it, thereby enabling life advice without imposing anystress on the user.

According to a fourth aspect of the present invention, there is providedan advertisement information providing method comprising preparing aserver which holds various kinds of advertisement informationcorresponding to physical situations, and extracting optimumadvertisement information corresponding to a situation of a user topresent the optimum advertisement information to the user.

According to the present invention, the server which hold various kindsof advertisement information corresponding to physical situations isprepared, the physical situation of the user is detected, and optimumadvertisement information is obtained from the server in correspondencewith the user's situation and presented to the user.

The user's current situation is determined in daily life, andadvertisement information such as optimum merchandise to deal withstress can be presented to the user on the basis of the determinationresult in consideration of the user's situation at that time. Thiscontributes to user's stress care and healthcare, and commerciallyeffective advertisements can be provided.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

FIG. 1 is a schematic block diagram showing a wearable type life supportapparatus according to the first embodiment of the present invention;

FIG. 2 is a flow chart showing the processing procedure of the wearabletype life support apparatus according to the first embodiment of thepresent invention;

FIGS. 3A to 3C are schematic views showing the principle of humanposture recognition used in the present invention;

FIG. 4 is a flow chart showing action and posture recognition processingused in the embodiment of the present invention;

FIG. 5 is a view for explaining the structure of a reference sensorinformation corpus related to stress, which is used in the embodiment ofthe present invention;

FIG. 6 is a view for explaining the dialogue structure for a situationregistered in the sensor information corpus used in the embodiment ofthe present invention;

FIGS. 7A, 7B, and 7C are views for explaining behavior-related pulserate trend graph display and a behavior input window for an abnormalvalue, which are used in the embodiment of the present invention;

FIGS. 8A and 8B are views for explaining a display window of vitalinformation related to a behavior, which is used in the embodiment ofthe present invention;

FIGS. 9A and 9B are views for explaining situation-dependentadvertisement display and an online shopping window according to thedisplay, which are used in the embodiment of the present invention;

FIGS. 10A, 10B, and 10C are views for explaining advertisement displaycorresponding to the degree of user's fatigue/stress and a road mapwindow, which are used in the embodiment of the present invention;

FIGS. 11A, 11B, and 11C are views for explaining advertisement displayscorresponding to the behavior information of the user and a road map,which are used in the second embodiment of the present invention;

FIG. 12 is a view for explaining the structure of a regional sensorinformation corpus related to stress, which is used in the embodiment ofthe present invention;

FIGS. 13A and 13B are a view and flow chart, respectively, showingcollection of information of a person who passes by a convenience storeand advertisement display, which are used in the embodiment of thepresent invention;

FIG. 14 is a view showing the structure of address book data includingdegree-of-stress information, which is used in the embodiment of thepresent invention;

FIG. 15 is a view for explaining the structure of a relational databaseof a schedule/task list, the degree of stress, and the degree offatigue, which is used in the embodiment of the present invention;

FIG. 16 is a flow chart of processing of returning a situation-dependentautomatic answering telephone message to a handyphone according to thethird embodiment of the present invention;

FIG. 17 is a flow chart of posture/action recognition based on peakdetection of a waveform as a function of time, which is used in theembodiment of the present invention;

FIG. 18 is a view showing an allowable range setting table of answercontents for each message sender, which is used in the embodiment of thepresent invention;

FIG. 19 is a view showing an answer device setting table for each user'ssituation, which is used in the embodiment of the present invention; and

FIG. 20 is a view showing message display window transition that is usedin the embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

The embodiments of the present invention will be described below indetail with reference to the accompanying drawing.

(First Embodiment)

A wearable type life support apparatus which can give a life adviceeffectively used for healthcare and medical administration by monitoringstress applied on the body of a user, and when stress occurs, relaxingthe stress to suppress mental and physical damage by the stress, and canalso give navigation by utilizing the stress to improve the ability ofthe user will be described here with reference to FIG. 1.

The wearable type life support apparatus shown in FIG. 1 has a mainmodule 101, a sensor modules 102, an acceleration sensor module 103, adisplay 104, a wrist watch type display 105, a headset 106, and ahandyphone 107.

Of these components, the main module 101 is a compact and lightweightcomputer such as a wearable computer, which has a function of analyzingcollected vital information to grasp the degree of stress and providingvarious kinds of supports in accordance with the degree of stress. Themain module 101 also has functions of processing collected data, sendingthe processed data to the database of a center, executing desiredprocessing using information obtained from the database, andtransmitting/receiving information or a control command to/from theheadset 106, display 104, or handyphone 107.

The main module 101 is formed from a memory 1011 and CPU 1012.Application programs and control programs for implementing theabove-described functions and an OS (Operating System) as the basicsoftware of the computer are stored in the memory 1011. The CPU 1012executes these programs to realize various desired processingoperations. The main module 101 also has a calendar/timepiece functionsuch that collected or processed information can be managed with a timestamp.

The main module 101 also has, e.g., a function of synthesizing acharacter string prepared as text data into a voice and outputting avoice signal, a function of recognizing a voice signal and converting itinto text data, and a function of collating data. The main module 101has, e.g., a BLUETOOTH™ chip 1013 for executing communication betweenmodules using BLUETOOTH™ as an international standard short-distanceradio communication device which has received a great deal of attentionin recent years. The main module 101 can store data to be handled in thesystem, systematically manage the entire system, execute datacommunication between the modules, and communicate with a home serverand management server (not shown).

The sensor modules 102 collect and transmit vital signals and areconnected to vital signal detection sensors such as a pulse sensor 1026for detecting pulses of a human body, a thermo sensor 1027 for detectingthe body temperature of the human body, and a GSR (Galvanic Skin Reflex)electrode 1028 for detecting the skin resistance of the human body. Eachsensor module 102 comprises a preprocessor 1025 that amplifies andpreprocesses the detection signal from each sensor, an A/D converter1024 that converts the sensor detection signal preprocessed by thepreprocessor 1025 into digital data, a CPU 1022 that executes variouscontrol operations and data processing, and a memory 1021. Each sensormodule 102 also incorporates a BLUETOOTH™ chip 1023 to execute datacommunication with the main module 101.

The structures from the sensors 1026, 1027, and 1028 to the sensormodules 102 are divided for the respective sensors. However, thestructures for the respective sensors may be integrated into a singlesensor module 102. Processing operations in each sensor and module 102may be integrated. A microcontroller (e.g., PIC16F877 available fromMICROCHIP TECHNOLOGY, INC.®) incorporating an A/D conversion functionmay be used as the CPU 1022 without preparing a separate A/D converter.

The preprocessor 1025 not only amplifies the signal detected by eachsensor by an appropriate gain but also incorporates a filter circuitthat performs high-pass filter processing depending on the type ofsignal or low-pass filter (anti-aliasing filter) processing inaccordance with the band of each signal. Each sensor has a plurality ofchannels as needed.

The handyphone 107 is a normal handyphone having a liquid crystaldisplay panel, a plurality of operation buttons 1071 including dialkeys, and a transceiver and inputs/outputs a voice. The handyphone 107also incorporates a BLUETOOTH™ chip and can communicate with the mainmodule 101. With this arrangement, voice input/output and cursor controlby cursor keys can be performed.

The display 104 is a display terminal formed from a portable liquidcrystal display panel which displays text data or an image and isexclusively construed for display. The display 104 has a BLUETOOTH™ chip1041 and can control display contents upon receiving display data andthe like from the main module 101 through the BLUETOOTH™ chips 1013 and1041.

The headset 106 is an input/output terminal used on the user's head,i.e., a headset incorporating a BLUETOOTH™ chip and COD camera (solidstate image sensor 1062) as well as a headphone (or earphone) andmicrophone 1061. The headset 106 is a device for voice/image interface.The headset 106 also incorporates a BLUETOOTH™ chip to transmit andreceive a voice signal and transmit an image. The headset 106 can beused simultaneously together with the handyphone 107.

The wrist watch type display 105 is a liquid crystal display panelhaving a wrist watch shape used on the user's arm. The wrist watch typedisplay 105 incorporates a BLUETOOTH™ chip to transmit/receive data orcommand to/from the main module 101.

This apparatus assumes digital communication by BLUETOOTH™. However, aradio communication device of any other scheme or a scheme of performingD/A conversion and transferring a voice signal to the headphone by FMmodulation may be employed. A voice signal may be transferred not byradio communication but by cable connection. An image may be acquired bya digital camera attached independently of the headset 106.

The function of the system with the above arrangement will be describednext.

FIG. 2 is a flow chart showing the flow of operation of the systemaccording to the present invention having the arrangement shown in FIG.1. The operation will be described with reference to the flow chart showin FIG. 2. The user carries the main module 101, sensor modules 102,handyphone 107, display 104, and headset 106. The pulse sensor 1026,thermosensor 1027, GSR electrode 1028, and acceleration sensor 1036 areset on the user, and then, the system is activated to start operation(step S201 in FIG. 2).

When the sensors are set and activated, they start to detect a vitalsignal. As a result, a pulse rate detection signal by the pulse sensor1026, a temperature detection signal by the thermosensor 1027, agalvanic skin reflex detection signal by the GSR electrode 1028, and anacceleration measurement signal by the acceleration sensor 1036 areobtained (step S202 in FIG. 2). The measurements are done continuously,periodically (every minute, every 10 minutes, or the like), or inaccordance with a measurement instruction from the main module 101 or auser's instruction.

The analog detection signals obtained by the sensors 1026, 1027, and1028 are amplified, filtered, and ND-converted by the sensor modules102. The ND-converted data are transferred to the main module 101through a short-distance radio device such as the BLUETOOTH™ chip 1023.

The main module 101 processes the measurement data by a preset logic,thereby determining the user's situation.

First, the main module 101 recognizes the action (behavior) or postureof the user on the basis of acceleration information obtained from theacceleration sensor 1036 (step S203 in FIG. 2).

The action/posture recognition method in step S203 is shown in theaction recognition flow chart of FIG. 4.

<Action/Posture Recognition in S203>

Referring to FIG. 4, the acceleration information is obtained byattaching, e.g., a three-dimensional acceleration sensor to apredetermined portion of the human body as a the acceleration sensor1036, thereby measuring the posture and action. The three-dimensionalacceleration sensor 1036 can be formed by perpendicularly laying out twotwo-dimensional acceleration sensors such as “ADXL202JC” available fromAnalog Devices, Inc.® The three-dimensional acceleration sensor 1036 isattached to, e.g., the waist to measure the motion of the body center(trunk) portion.

As shown in FIG. 3A, 3B, or 3C, the tilt of the sensor is obtained froma DC component, i.e., an output obtained by passing the accelerationwaveform from the acceleration sensor 1036 through a low-pass filter,thereby detecting the posture.

For example, the sensor 1036 is attached to the joint portion of thebase of the femoral region of a user P. An angle is obtained from thevertical and horizontal components of the DC component, and the posturecan be recognized on the basis of the angle: when the sensor is almosthorizontal, the user is lying on his/her back (FIG. 3C) or on his/herface, when the sensor is almost vertical, the user stands upright (FIG.3A), and the sensor has an angle therebetween, the user is sitting (FIG.3B).

The action (walking, running, bicycle, car, train, or the like) can beidentified from the frequency component and variation pattern of an ACcomponent. For example, the fundamental frequency of walking is 60 to100 (times/min), and that of running is 120 to 180 (times/min). Hence,the fundamental frequency component is acquired by performing frequencyanalysis (FFT (Fast Fourier Transform)) for the detected signal (S401 inFIG. 4) or by detecting waveform peaks and peak interval. The powers inthe respective bands are compared, thereby recognizing walking orrunning.

If the acceleration sensor 1036 is attached not to the waist but to aleg portion, e.g., the femoral region of a leg, the acceleration duringwalking is maximized by vibration when the foot touches the ground.However, during running (running fast), the acceleration is maximized byvertical movement of the waist when the feet touch the ground. For thisreason, for walking, the fundamental frequency must be further halved.Alternatively, since the vertical amplitude for running is larger bytwice or more than that for walking, the amplitude values at the time ofpeak detection are compared, thereby recognizing walking or running.

The above methods may be combined, or either method may be used.

According to FIG. 4, FFT is executed for latest 128 points of waistportion acceleration waveform (S401). DC component, walking band, andpower of walking band are calculated (S402). It is determined thatwalking/running band for DC component≧set value (S403). If thedetermination is YES, it is determined whether the running band is equalto or higher than the power of walking band set ratio or more (S404). Ifthis determination is YES, run is performed (S405). The processing isstopped while keeping status as running during the running period(S406). If the determination is NO, walk is performed (S407). Theprocessing is stopped while keeping status as walking during a walkingperiod (S408). If the determination of step S403 is NO, vertical andhorizontal components of DC component are acquired (S409), and an angleis calculated (S410). The angle is determined as 0°-15°, 15°-60° or60°-90° (S411). The angle of 0°-15° is determined as lie on back (S412),the angle of 15°-60° is determined as sit (S413), and the angle of60°-90° is determined as stand (S414).

In the flow chart shown in FIG. 4, FFT is used for analysis processing.However, the present invention is not limited to this. Another spectrumanalysis device such as wavelet transformation may be used.Alternatively, pattern matching between the waveforms of fundamentalfrequencies may be performed to recognize “running”, “walking”,“ascending stairs”, or “descending stairs”. Simple peak detection may beperformed, and the number of steps may be measured from the period.Alternatively, as shown in FIG. 17, peak detection may be performedalong the time axis to obtain the walking or running pitch. In otherwords, the amplitude of a waist portion acceleration is calculated(S1701). It is determined whether the amplitude≧set value (S1702). Ifthe determination is YES, the peak of a vertical acceleration isdetected upon lapse of a refractory period (S1703). A pitch iscalculated from a time lag from a preceding peak (S1704). It isdetermined whether the amplitude≧a set value and the pitch≧a set value(S1705). If the determination is YES, run is performed (S1706). Theprocessing is stopped while keeping the status as running during arunning period (1707). If the determination is NO, a walk is carried out(S1708). The processing is stopped while keeping the status as walkingduring a walking period.

If the determination of step S1702 is NO, vertical and horizontalcomponents of DC component are acquired (S1710), and an angle iscalculated (S1711). The angel is determined as 0°-15°, 15°-60° or60°-90° (S1712). The angle of 0°-15° is determined as lie on back(S1713), the angle of 15°-60° is determined as sit (S1714), and theangle of 60°-90° is determined as stand (S1715).

Posture/action recognition is done by the main module 101. However,posture/action recognition may be done by the sensor modules 102, andresultant status data (posture and action) may be transmittedperiodically or when a change occurs. To recognize a position indoors,the main module 101 communicates with a radio tag (e.g., a BLUETOOTH™chip) prepared in each room to detect the location. Outdoors, a positioninformation service of a handyphone (or PHS) or a GPS (not shown) isused to detect the location.

With the above operation, action (behavior) of the user can berecognized from the acceleration information. When the above processingis ended, the flow advances to determination processing in step S204.

The determination processing in step S204 is executed to check whetherthe pulse rate, body temperature, GSR (Galvanic Skin Reflex), posture,action, or voice has changed. If NO in step S204, the flow returns tostep S203 in FIG. 2. If YES in step S204, the flow advances toprocessing in step S205.

For the determination processing in step S204, the pieces of informationof the pulse rate, body temperature, GSR, posture, action, or voice arenecessary. Of these pieces of information, pieces of vital informationsuch as the pulse rate, body temperature, and GSR are measuredsimultaneously with the above-described user's behavior state detection.The measuring method will be described below.

<Vital Information Measurement>

The pulse rate is obtained by the pulse sensor 1026. The pulse sensor1026 detects a pulse by photoelectrically sensing a change inbloodstream through peripheral blood vessels in, e.g., a finger, wrist,or ear as a part to be measured. A portion where blood vesselsconcentrate is irradiated with light using, as a light source, anincandescent lamp or LED (Light Emitting Diode) capable of emittinglight having an absorption wavelength of hemoglobin contained in bloodin a large quantity. The transmitted or reflected light is received by aphotodiode as a photoelectric element, photoelectrically converted, andmeasured.

A potential waveform on which the influence of light absorption byhemoglobin that flows in the bloodstream is obtained as a detectionsignal from the component, e.g., photodiode of the pulse sensor 1026.This signal is amplified by the preprocessor 1025, filtered, convertedinto digital data by the A/D converter 1024, transmitted from the sensormodule 102 through the BLUETOOTH™ chip 1023, and thus received by themain module 101 as potential waveform data as pulse rate data.

The main module 101 analyzes the peak interval or frequency of thepotential waveform of the received pulse data and calculates the pulserate from the peak frequency. The analysis and calculation are done bythe CPU 1012.

The pulse sensor 1026 can have the shape of an earring, ring, or wristwatch, and any shape can be employed. Alternatively, the pulse sensor1026 may be incorporated in the headset 106 shown in FIG. 1 such thatthe light emitting diode (incardescent lamp or LED) and photoelectricelement (photodiode) or CdS cell are arranged on the front and rearsides of an earlobe. The light emitting and photoelectric elements maybe incorporated in a ring or wrist watch, and the sensor may beincorporated in each module.

When, e.g., two pulse sensors 1026 are set at a predetermined intervalto measure two waveforms, the resultant digital signals are received bythe main module 101, the blood pressure or the elastic modulus of bloodvessels can be obtained from the difference between the waveforms.

In addition, when LEDs for two wavelengths, i.e., absorption wavelengthof oxyhemoglobin and that of reduced hemoglobin are used to irradiateblood vessels with light, and reflected light is measured, the oxygensaturation in the artery can be calculated.

Alternatively, when blood vessels are irradiated with light from an LEDhaving an absorption wavelength of glucose, the blood sugar value can bemeasured using the reflected light.

In measuring the pulse rate, the heartbeat rate may be calculated usingan electrocardiogram on the basis of the peak interval or peak frequencyobtained from frequency analysis (this method is medically stricter).

The pulse rate value, blood pressure value, and blood sugar value arealways measured and stored in the memory 1011 of the main module 101.Alternatively, measurements are performed periodically or at anarbitrary time in accordance with an instruction from the main module101 to store data.

To measure the body temperature, the thermosensor 1027 is used. Thethermosensor 1027 is formed from a detection device such as athermocoupler or thermistor. The detection device is brought intocontact with the body surface of the user, and the output from thedetection device is converted into a temperature in accordance with thecharacteristics of the sensor.

To measure the GSR, a pair of electrodes are attached to the bodysurface of the user at a predetermined interval, a weak current issupplied across the electrodes, the potential difference and currentvalue are measured, and the resistance value is calculated using themeasurement values. In the measurement, drift components are removedfrom a waveform corresponding to the measurement result obtained fromthe two electrodes, and then, the amplitude of the leading edge and thenumber of leading edges are acquired. The drift components are acquiredfrom the average value of the waveform.

These data are also converted into digital data, transmitted to the mainmodule 101 by radio, and stored in the memory 1011 of the main module101, like the output from the pulse sensor 1026.

Together with these measurement values, analog (voltage) data from theacceleration sensor 1036 is also A/D-converted and stored in the memory1011. These data are linked with each other by giving measurement timesto the respective data or recording the data in the same record.

The pieces of vital information are obtained in this way. If the vitalinformation or posture, action, or voice information changes, the CPU1012 of the main module 101 acquires current schedule data by processingin step S205.

The presence/absence of a change in vital information or posture oraction information is determined on the basis of the followingreference.

In the measurements continued in the above-described manner, a changemeans that the vital information (pulse rate, body temperature, or GSR)abruptly changes or becomes abnormal (for example, the pulse rate is“120” or more, or the body temperature is “37° C.” or more), or theaction information represents a status change such as “the user stopswalking”. When such a change is detected (step S204 in FIG. 2), the CPU1012 of the main module 101 acquires schedule data including the changetime by, e.g., PIM (Personal Information Manager) software that belongsand is compatible to the OS of the main module 101 (by, e.g.,application MICROSOFT® OUTLOOK® 2000 if the OS (Operating System) of themain module 101 is WINDOWS® available from MICROSOFT®) (steps S205 inFIG. 2).

Consistency between the pieces of information and the schedule ischecked (step S206 in FIG. 2), and any inconsistencies and deficientinformation are acquired from the user by speech dialogue andsupplemented (step S207 in FIG. 2).

The method of acquiring and supplementing information from the user byspeech dialogue will be described below.

Assume that the absolute values of the AC component outputs from theacceleration sensor 1036 in the three axial directions (x-axis, y-axis,and z-axis) fall outside a preset range. The CPU 1012 of the main module101 determines that “the user is acting” because the absolute values ofthe AC components in the three axial directions exceed the set value,and asks the user “What are you doing now?” and executes voicerecognition for the answer, thereby inputting behavior information.

More specifically, text data “What are you doing now?” is prepared asquestion data, and this data is synthesized into a voice signal andtransmitted to the headset 106 through the BLUETOOTH™ chip 1013.

The headset 106 receives the voice signal through the BLUETOOTH™ chip ofits own, transfers the voice signal to the headphone, and causes it tooutput voice. The user who is wearing the headset 106 can hear thequestion from the main module 101, “What are you doing now?”

The user answers this question with his/her current situation byspeaking. For example, “ascending stairs” or “standing up from a chair.”The user's voice is converted into a voice signal by a microphone 1061of the headset 106, and the headset 106 transmits the voice signalthrough the BLUETOOTH™ chip of its own by radio. The main module 101 ofthe user receives, through the BLUETOOTH™ chip 1013, the voice signaltransmitted by radio. The CPU 1012 of the main module 101 executes voicerecognition processing for the voice signal and grasps the contents.

Using the PIM software, the CPU 1012 of the main module 101 acquires,from a database DB1, the user's current schedule data managed by thesoftware (step S205 in FIG. 2). The schedule is prepared in advance inaccordance with the behavior plan of the user by specifically settingdates, times, and contents.

The CPU 1012 of the main module 101 collates the behavior datarecognized from the acceleration with the schedule data (step S206 inFIG. 2). If the collation fails, a dialogue for checking it may be doneto correct the expectation result on the basis of the result ofdialogue. Conversely, when the user is standing still for a long time,it is checked by collating the schedule whether the behavior has noproblem. If the collation fails, the CPU inquires of the user.

This inquiry is also done by, e.g., speech dialogue.

Collation with the schedule may be triggered by vital information. Forexample, when the pulse rate increases at the scheduled desk work time,the behavior possibly changes, and the CPU asks the user, e.g., “Are youwalking or running?” If it is determined as a result of check that theuser is at desk working, the increase in pulse rate is supposed to becaused by a mental or morbid factor. The main module 101 asks the user“Are you feeling unwell?” through the headset 106 to check whether theuser feels stress.

If no answer to this question is received from the user, the CPU 1012 ofthe main module 101 recognizes that the user's illness is serious. Inthis case, under the control of the CPU 1012, the main module 101searches for medical information registered in advance, controls thehandyphone 107 to execute dial call origination, and notifies the familyphysician of the emergency by, e.g., transmitting a voice message or amail message prepared for emergency from the handyphone 107, or alarmsthose who are around the user.

The CPU 1012 of the main module 101 estimates the situation or lifebehavior on the basis of the measurement data, action, and schedule(step S207 in FIG. 2).

That is, the CPU searches a personal sensor information corpus DB2 inthe terminal (main module 101) for sensor information with the sameconditions on the basis of the obtained behavior information (where theuser is and what the user is doing) and date/time data of the user, andcompares the obtained sensor information with the measured sensorinformation to determine whether the value or change trend has asignificant difference.

The CPU 1012 of the main module 101 measures the degree of stress fromchanges in pulse rate, body temperature, and GSR corresponding to thelife behavior and situation (step S208 in FIG. 2).

In the main module 101, the standard range of each vital information isheld in the memory 1011 as a parameter in correspondence with eachbehavior information, and each vital information is compared with thestandard range. When the information to be measured falls within thestandard range, the value is determined to be normal. When theinformation falls outside the standard range, the value is determined tobe abnormal. Each parameter may be automatically set on the basis ofdata in normal state. Alternatively, the pattern (waveform) of a changein vital information for a certain behavior is stored, a correlationcoefficient with respect to the pattern is acquired, and abnormality isdetermined when the correlation coefficient is equal to or smaller thana set value. When the value deviates from the normal value, it can bedetermined that the degree of stress becomes higher than that in thenormal state due to, e.g., disturbance. With this processing, whetherthe degree of stress is normal or abnormal can be detected for eachbehavior.

Even in the following case, whether the degree of stress is normal orabnormal can be detected. For example, FIGS. 7A, 7B, and 7C are viewsshowing displayed vital information/behavior display windows. As shownin FIG. 7A, a pulse rate trend graph is displayed on the monitor windowevery moment, indicating that the pulse rate abruptly increases duringwalking. Such an abrupt increase deviates from the normal pattern andcan be determined as abnormality. This pattern can be estimated as arunning state (the user is running). Hence, as shown in FIG. 7B, aquestion window, “A change in measurement data is detected. You seem tobe running, and the pulse rate is higher than usual. What is the matterwith you?” is presented on the display panel, and the user is requestedto answer the question. Answer examples such as “I'm running not to belate for work in the afternoon”, “for training”, and “being chased” areprepared and displayed, and the user is made to select one of them. Ifthe user selects “I'm running not to be late for work in the afternoon”,it can be determined that “the pulse rate has increased because the useris in a hurry”, and consequently, it can be detected that “the degree ofstress is + (plus)” (FIG. 7C). Even when the main module 101 executessuch processing, whether the degree of stress is normal or abnormal canbe detected for each behavior.

Next, to grasp the contents of the user's feeling for the degree ofstress, the user is asked about subjective information by speechdialogue (step S208 in FIG. 2). The dialogue structure of the speechdialogue used at this time is built by processing in the main module 101in accordance with the user's situation (step S209), or a dialoguestructure stored in the past in the personal sensor information corpusDB2 serving as a material database is acquired together with sensorinformation. This will be described below in more detail.

<Dialogue Structure Acquisition Method>

A method of acquiring the dialogue structure from the sensor informationcorpus DB2 will be described with reference to FIG. 5. As shown in FIG.5, the reference sensor information corpus DB2 has, in one record,environment (season, time, place, posture, action, behavior, andexpected behavior), physical information (pulse rate, body temperature,GSR, and voice pitch), degree of stress, and dialogue structure. Thesimilarity between the environment and physical information and themeasurement data (vital information) obtained from the user is obtained,and the degree of stress is calculated using an evaluation function. Avalue equal to or larger than a certain reference value is recognized asa record that represents the user's situation, and the degree of stressand a dialogue structure for coping with the stress are acquired (stepS210 in FIG. 2).

For the degree of stress determined (acquired from the average sensorinformation corpus), the user may be asked a question “You seem to beconsiderably tired”, “You seem to be tired a little”, or “Are youtired?” The degree of stress may be corrected for the user on the basisof an answer from the user, and the correction result may be reflectedon the corpus DB2.

For example, assume that the pulse rate increases before a meeting. Thesystem grasps this situation and asks the user a question “Your pulserate is rising before meeting. Are you planning presentation?” The userreturns to the system an answer “Yes, I have important presentation. Ifeel stressful”. Upon receiving this answer, the system side gives anadvice to the user to get rid of the stress, “Breathe deeply and relax,or how about something to drink?”, and the user replies “OK”.

The main module 101 registers the dialogue result in the sensorinformation corpus DB2 as a dialogue structure for a specific situationby processing in the CPU 1012. In this example, a dialogue structure asshown in FIG. 6 is registered as a dialogue result. For a situation“dialogue structure: pulse rate rises before meeting”, a dialoguestructure for the situation is registered in the sensor informationcorpus DB2 with contents “System: “Your pulse rate is rising beforemeeting. Are you planning presentation?””→“User: “Yes, I have importantpresentation. I feel stressful””→“System: “Breathe deeply and relax orhow about something to drink?””→“User: “OK””

The degree of stress may be detected by continuously analyzing thefrequency component of the user's voice. As a characteristic feature ofa human voice, the characteristic feature of the degree of stressappears in the frequency component and time-axis component of voice sothat, for example, the frequency of the generated voice becomes higherthan usual. On the basis of this fact, the degree of stress can bedetected by continuously analyzing the frequency component of the user'svoice during the dialogue. Hence, when the degree of stress is measuredby voice frequency analysis, the degree of stress can be more accuratelymeasured (step S211 in FIG. 2).

Alternatively, if the user feels difficulty (pressured) to speak withsomeone or one of participants of the current meeting, it is determinedthat the degree of stress is high. First, subjective data for thatperson is stored in the address book of the PIM software. Thedetermination is done on the basis of vital information (pulse rate,GSR, and the like) when the user meets the person. If the pulse rate ishigh or the integrated value of GSR becomes large during speaking withthat person, items “person (name)”, “address”, “telephone number”, . . ., “degree of stress” are stored in the address book having a structureshown in FIG. 14 as data of a person for which the user feels stressful.

When the user meets the person, the person is recognized from the imageor by inputting the name by voice recognition whereby the user's PIMdata is obtained from the database DB1 to acquire the data of the degreeof stress for that person. In addition, the emotion of the person isrecognized from the speech and behavior of the person, the degree ofstress is acquired even from the current vital information, and thedegree of stress of the user is determined by combination of these data.

The degree of stress is set as frequency data, and the data are averagedevery time the user meets that person. The expected degree of stressbecomes high for a person for which the user habitually feels stressful.

Alternatively, the situation when the user meets a person (e.g.,schedule information such as “ordinary meeting” is recorded in linkagewith the degree of stress, and the degree of stress corresponding toeach situation is stored in the corpus having a structure shown in FIG.15. When schedule data in the future and participants (persons) areinput, the expected degree of stress is calculated on the basis of apredetermined degree-of-stress formula, so the user is advised beforethe meeting to control the stress to some extent.

A person sometimes feels stressful depending on the distance fromanother person. This is understood as a concept “personal space”. Thedistance changes even depending on the mental condition of a person.When the degree of stress by this concept is also measured, the degreeof stress can be more practically reflected. More specifically, thedistance from a person is measured using a distance sensor (e.g., anultrasonic distance sensor or infrared distance sensor) attached to theuser, recorded in association with the situation such as the name of theperson and date/time/place. The personal space for each situation isalso measured, and the degree of stress is counted for each situation inaccordance with the person or the time while the person is in thepersonal space.

Another factor for stress build-up is a bad smell or strong smell. Theintensity and kind of peripheral smell may be recorded using an odorsensor and converted into a degree of stress.

Still another factor for stress build-up is time. The degree of stressbecomes high when the schedule is tight or when the user has a work withtime limit. The degree of stress is linked with task (To-Do) data or anevent of schedule and recorded, as shown in FIG. 15. As the time limitnears, it is determined that the degree of stress is high.

The schedule, task, and corresponding degree of stress are stored in thecorpus shown in FIG. 15, which has items “season”, “day of week”,“schedule/task (To-Do)”, “content/volume”, . . . , “degree of stress”,and “degree of fatigue”. The schedule and task are freely input. Tosearch the corpus for an item name, keyword search is used, and theclosest item is obtained in consideration of other situation data.

The degree of stress and subjective information of the user are acquiredby the above device, deficient data are supplemented and corrected, andthe subjective information is recorded (step S212 in FIG. 2). When thedegree of stress is more than a predetermined threshold value, and it isdetermined that the user is stressed, the data of the degree of stressis transmitted to the information providing service agent together withthe data of the user's situation, and an information providing serviceappropriate for the user is offered on the basis of the data (step S213in FIG. 2). Potential service menus are

1. Distribution of music, image, and short—short story (relaxation)

2. Advice/navigation for event (to increase concentration)

3. Combined service of 1 and 2

The user is inquired about the service menu at the start time of use ofthe terminal (in this case, the start time of use of the main module 101and the like) or when the main module 101 and the like are powered on.The user can set the service menu as he/she likes.

For the service contents, if the user selects, e.g., the relaxationcourse, and the user is stressed, a voice message “You seem to be tired.How about music? Please look at the display” is presented to the user,and a music list is displayed on the portable display such as thedisplay 104 or wrist watch type display 105.

In this case, the system links to a content distribution service agentfor music or the like, extracts optimum contents for the user from thedatabase of the service agent on the basis of the data of the user'ssituation (where the user is and what the user is doing) and the data ofthe degree of stress (the degree of fatigue and whether the user isbeing stressed), and presents candidates to the user. When the userselects a content from the list, a confirmation message “playback ofthis content costs \∘∘. OK?” is displayed. When the user inputs anacknowledge, the system buys and downloads the content and displays orplays back the stream of data. A questionnaire of the result is acquiredand fed back to the database.

For the “advice/navigation for event” course, a service is offered tonavigate the user such that the maximum efficiency can be obtainedwithin the allowable range while allowing stress to some extent. Variouskinds of events are prepared in accordance with the situation of eachuser. For example, “professional sports player”, “amateur sportsplayer”, “examination”, “presentation”, and the like are prepared. Whenthe date of actual event is set, the CPU 1012 of the main module 101sets navigation menus from the service start day to the actual event andduring the event and executes the service.

The menus may be continuously set in a scale with which relaxation canbe obtained at maximum efficiency. In this case, break and relaxationnecessary for maximizing the efficiency are provided. If the servicemainly aims at eliminating stress, the amount of break and relaxation tobe provided is increased.

The relaxation service is provided at a timing according to the measureduser's situation. When the user is acting to have an effect on thetarget event or given task (e.g., during study for an examination), norelaxation service is provided. When the behavior continues, and theuser starts feeling tired, the service is provided with relaxationadvice. Alternatively, control may be performed such that a parameterthat reflects a change in sympathetic and parasympathetic nerves, e.g.,a fluctuation in heart rate, is measured, when the sympathetic nerve isactive, an advice menu for maximizing efficiency under that situation isdisplayed, and when the parasympathetic nerve is active, the relaxationservice is provided because a break is necessary.

Alternatively, since the control method changes depending on whetherstress is preferred or undesirable for the user, the type of stress maybe estimated from the user's situation, and a service according to thetype of stress may be provided.

<Method of Determining Type of Stress>

The method of determining the type of stress will be described. Stressis detected by the method that was already described above. After that,indices that represent whether the stress is preferred or undesirablefor the user are continuously expressed as numerical values, evaluatedby the user, and stored in the personal sensor information corpus DB2.In the same situation, it is determined whether “navigation foreliminating the stress is to be performed” or “navigation for maximizingthe ability is to be performed”.

With the above processing, the type of stress can be determined, and howto reflect the stress on the service can be determined.

Since the vital information and behavior information of the user arealways acquired, window information which allows the user to check thehistory for a predetermined past period from the current time may begenerated on the basis of the monitor results of the vital information,posture/action information, and the like, sent to the terminal, anddisplayed on the user's display such that the user can refer to thehistory. In the example shown in FIG. 8A, action life information (inthis example, [walk (walking)] move to dining room for lunch, [sit(sitting)] meal, [walk (walking)] finish lunch and move to private room)for a predetermined past period from the current time, or the currentbehavior state (running) and current physical condition (pulse rate ishigh) are displayed together with operation buttons and the like. Inthis example, when desired one of the pieces of displayed action lifeinformation is selected on the window, the graph of vital signals atthat time is displayed, and the user can see the transition state (FIG.8B). In this example, the vital signal graph shows the pulse wave andpulse rate, though any other vital signal can be displayed.

In the above first embodiment, pieces of vital information of the user,including the pulse rate, body temperature, and GSR, are acquired, andthe posture information of the user is also acquired. A change in user'sphysical condition is detected from the pieces of information. When thepieces of information are collated with the behavior schedule of theuser, and the change in user's body does not match the behaviorschedule, the degree of stress is measured, and a service or advice foreliminating or relaxing the stress, or maximizing the ability by usingthe stress is provided to the user in accordance with the degree ofstress and the user's situation.

Hence, a life support apparatus which can relax stress and suppressmental and physical damage by the stress to achieve effective medicaladministration and healthcare can be provided. In addition, a lifesupport apparatus capable of increasing the ability by taking advantageof stress can be provided.

The second embodiment will be described next, in which when a user feelsstressful, a measure recommended to the user can be commerciallyadvertised to realize healthcare of the user and commercial effect, orpieces of information related to the stress are collected from the userand used for consulting or marketing business to effectively use theinformation for business.

(Second Embodiment)

In the second embodiment, in providing a service or presentinginformation, the physical and mental conditions of a user are alwaysgrasped, and an advertisement corresponding to the conditions isdisplayed through a wearable computer. The hardware configuration to beused is the same as that shown in the block diagram of FIG. 1.

The behavior information, vital information, and degree-of-stressinformation of the user are acquired by the same arrangement and methodas in the first embodiment in the above-described way. After the piecesof information are acquired, an advertisement genre corresponding to theuser's situation is estimated in a wearable computer (main module 101 inFIG. 1) on the basis of the acquired information, and data of theselected advertisement genre is transferred to an advertisement serviceagent.

As described above, the main module 101 has a BLUETOOTH™ chip 1013 forradio communication. As a network using BLUETOOTH™ is built, many radiotags (BLUETOOTH™ chips) as BLUETOOTH™ transmitting/receiving sectionsare installed at various places such as on a street, at a station, or ina building, and the main module 101 communicates with a radio tag,thereby communicating with the network. The server of an advertisementservice agent is connected to the network. The server of theadvertisement service agent distributes, through the network,advertisements corresponding to genre data sent from the main module 101of the user. The advertisement distribution is done in a form of mail,voice message, banner on a display, or the like, and the advertisementsare exchanged through the BLUETOOTH™.

For advertisement distribution on the server side, optimum contents areprovided and displayed on the device on the user side in accordance withthe current situation of the user at the most effective timing foradvertisement. For example, if the user is on his/her way to the office,an advertisement related to the work of the day is provided anddisplayed, as shown in FIGS. 11A and 11B. If the user is on his/her wayto home, an advertisement related to hobby or articles for daily useincluding foods and clothes, or an advertisement of a supermarket nearthe route to home is provided and displayed before the purchase chanceof the user is lost.

The display contents and display medium can be switched in accordancewith the user's mental condition (whether the degree of stress is highor low). For example, when the degree of stress is high, and the user'smind is occupied with his/her own affairs, advertisement distribution isstopped. Advertisements are distributed later when the user is relaxed.

In the above description, the advertisement distribution agent selectscontents to be distributed. However, the terminal side (wearablecomputer) may have a function of selecting an advertisement to bereceived and displayed in accordance with the situation of the userhimself/herself. Alternatively, the server of the service agent mayexecute the filtering in accordance with setting information from theuser and distribute advertisements.

Not only the contents to be displayed but also the display medium may beswitched in accordance with the user's situation. For example, when itis recognized from behavior information that the user is walking, anadvertisement to be provided is presented not by character and imagedata but by voice data.

As another example, personal behavior data and subjective informationfor the data may be collected and used for marketing/consultingbusiness. Since the wearable computer (main module 101) stores personalbehavior data and subjective information for the data, the agentacquires the pieces of information provided from the user. Since thepieces of information are personal information, they must be providedbased on user's will. For this reason, the pieces of information aretransmitted to the service side by transmission operation by the userhimself/herself.

For a consulting service, the pieces of collected information mustcorrespond to the consulting service to be provided. For example, for aconsulting service to a convenience store, pieces of information must becollected from persons who have come to or near the convenience store.As shown in FIG. 13A, to collect data of a person P who has arrived atthe neighborhood (area A) of the store, BLUETOOTH™ radio tags areinstalled at an near the store and connected to a person who has enteredthat area using the BLUETOOTH™ (step S1301 in FIG. 13B). When connectionis successfully established, the system inquires of the person, presentsthe types and distribution destination of data, and obtains user'sconsent about whether the data may be sold (step S1302 in FIG. 13B).

For easy data collection, an information charge is paid to the user whohas communicated at that time, or a special coupon is offered to theuser (step S1303 in FIG. 13B). In addition, to survey stores where theresidents near the convenience stores buy, pieces of information ofcommercial areas familiar to the residents are collected. For thecollected data, when only anonymous data is used, as shown in FIG. 12,and the user is informed that only anonymous data is used, the collecteddata can be sold as merchandise without any serious problem.

By collecting information in the above way, personal behavior data ofmany persons who live/work around the store and subjective stressinformation for the behavior data are collected, and therefore, themerchandise display contents at the convenience store can be easilyoptimized.

As described above, when a mechanism is built to collect data using thewearable computer capable of collecting pieces of information ofbehavior of a user and the information of the degree of stress caused bythe behavior and collect the collected data in the server on the networkusing the BLUETOOTH™ the data can be used for marketing and consultingservices in terms of stress, e.g., the data can be reflected on thestock of pieces of merchandise which are useful to get rid of the stressor advertisement distribution for sales campaign in correspondence withthe degree of stress of each person. For commercial use, since thestatistic of persons who pass near a store can be acquired, and theactual conditions of consumers can be grasped, the merchandise displaycan be controlled for each time zone.

Conversely, when a person suitable to the merchandise display contentscomes (steps S1304 and S1305 in FIG. 13B), the advertisements of themerchandise and store can be displayed (steps S1306 and S1307 in FIG.13B). For example, when a person who happens to pass the store seems tobe stressed (step S1305 in FIG. 13B), an advertisement that recommends acandy or food of his/her favorite is distributed (steps S1306 and S1307in FIG. 13B) and displayed on the wearable computer of that person (stepS1308 in FIG. 13B) to stimulate his/her will to buy. A system capable ofpromoting sale can be built and operated.

For such marketing survey, not only information at a specific point asdescribed above but also information of a person near a surveyor may becollected by giving a wearable computer to the surveyor.

Another embodiment will be described below. For example, an agent thatsells healthy foods lends or sells at a low price a wearable computerset as shown in FIG. 1 to a consumer. Using the wearable computer set,the behavior information, degree of stress, and health state of the userare measured by the above-described device.

The consumer (user) transmits the data of his/her own to the healthadvice service agent. The service agent receives the medical examinationresult. Alternatively, the pieces of information are periodicallycollected and automatically transmitted to the service agent, or theagent accesses the terminal of each user to collect information anddetermine the situation. It is determined whether the situation allowspresentation of an answer to the user, and the examination result istransmitted from the system of the service agent using a mediumaccording to the situation. The user side receives the transmittedexamination result by the user's terminal.

Simultaneously, a banner advertisement of a healthy food or medicine(FIGS. 9A and 10A) related to the examination result is displayed, orthe homepage of an online shopping service is displayed (FIG. 9B). Forexample, for a user who feels tired, a banner advertisement or a page ofonline shopping, that recommends a vitamin C tablet or medicine forpromoting nutrition, such as a nutritive drink, is displayed. Toactively obtain the sales promotion effect, a coupon service is executedto offer “a point service for use of the service as a benefit” or “aspecial coupon (e.g., free drink ticket or the like) as a benefit”. Whenthe advertiser is a store, a store guide map display button is displayedon the banner advertisement (FIG. 10A). When the user operates thisbutton, a map (FIG. 10B) for the store or a voice guidance (FIG. 10C)can be effectively given.

As described above, the life support apparatus according to the secondembodiment uses a wearable computer having a BLUETOOTH™ as ashort-distance radio communication device and a function of collectingvital information and behavior information. This user carries theapparatus and uses for his/her health care against stress. In addition,pieces of information for the stress are collected from a pedestrian tothe server through a radio tag (e.g., a BLUETOOTH™ chip) on the streetand network. When the user feels stressful, to eliminate the stress, acontent for commercially advertising a measure recommended to the useris distributed to the user to keep him/her informed. With thisarrangement, a system capable of realizing healthcare of the user andproviding a commercial effect can be built. In addition, a system whichcan be effectively used for business by analyzing pieces of informationof the behavior of a user and information related to stress, which arecollected in the server, and using the information for consulting andmarketing services can be built.

(Third Embodiment)

In the third embodiment, a life support apparatus which presents auser's situation acquired using the above user's situation recognitiondevice by a means optimum for each inquiring medium in response to anexternal inquiry from a handyphone, mail, or beeper is provided.

In this embodiment as well, the hardware configuration is the same as inFIG. 1, and the behavior information, vital information, anddegree-of-stress information of a user can be acquired by the samearrangement as in the first embodiment.

An example in which a real-time voice (telephone) message is received bya handyphone 107 will be described.

FIG. 16 is a flow chart showing the processing.

When a terminal (main module 101) is activated, the behaviorinformation, vital information, and degree-of-stress information of theuser are acquired by the main module 101 in accordance with the samearrangement and method as in the first embodiment. In case of anincoming call at the handyphone 107 (steps S1601 and S1602 in FIG. 16),a CPU 1012 of the main module 101 looks up a set mode table shown inFIG. 18 (step S1603 in FIG. 16).

In the set mode table shown in FIG. 18, information representing“whether an answer to an incoming call can be sent (YES/NO)”, “thecontents to be returned”, “whether the fact is to transmitted”, and thelike can be set for each category of the caller and for each person.Several types of such table are stored in the handyphone 107 in advance.When the user selects and sets the table on the handyphone 107, the mainmodule 101 can acquire and use the table information.

The CPU 1012 of the main module 101 starts user's situation recognitionprocessing in accordance with the condition of the set mode table unlessthe answer is inhibited. Various data (vital information) collected byan acceleration sensor module 103 and sensor module 102 of the user aretransmitted to the main module 101. The acceleration sensor module 103includes a memory 1031, a CPU 1032, a BLUETOOTH™ chip 1033, and apreprocessor 1035. Upon receiving these data, the CPU 1012 of the mainmodule 101 recognizes the user's situation, as in the first and secondembodiments, and accesses the handyphone 107 through the BLUETOOTH™ chipon the basis of the information. In other words, it is determinedwhether permission for automatic answer is set for a caller (S1604). Ifthis determination is YES, measuring of a pulse rate, body temperature,GSR, and acceleration is started (S1605). The posture and action isrecognized from the acceleration (S1606). Current schedule data isacquired (S1607). The posture and acion are collated with the schedule(S1608). The situation and life behavior are estimated on the basis ofmeasurement data, action and schedule (including speech dialogue touser) (S1609). The degree of stress of the user is measured from thespeech dialogue, vital information and lifer behavior information as inFIG. 2 (S1610). The CPU 1012 extracts publishable information from theset mode table incorporated in the handyphone 107 and creates voicepresentation text by combining the information (step S1611 in FIG. 16).

For example, assume that it is determined that the user is on a train bysituation recognition on the basis of information from the accelerationsensor module 103 and schedule, and that the user is in the sectionbetween Jiyugaoka and Nakameguro (Toyoko Line) from position information(for outdoors, the location is detected using the position informationservice of the handyphone (PHS) or a GPS (not shown)). According to theuser's schedule, he/she is already waiting for a friend in Shibuya now,so text “I'm on the train, and will arrive at Shibuya in 10 minutes” iscreated. This text is synthesized into a voice message and returned tothe caller as an answer from the handyphone (step S1612 in FIG. 16).

This text may be displayed on the handyphone of the user (callee), and awindow for inquiring of the user about whether the answer can betransmitted may be displayed. When the user selects “YES”, the answer istransmitted. This prevents the situation from being carelesslyexternally transmitted.

Alternatively, upon reception of an incoming call, information such asthe name of the caller is displayed on a portable display 104 or thedisplay section of the handyphone 107, as shown in FIG. 20, and ananswering message is selected and input on the window. For anotification medium, the table shown in FIG. 19 is set, and anotification is sent in accordance with the table.

The example of table shown in FIG. 19 has the following meaning. Whenthe location is “outdoor”, and the action is “walk”, the incoming callnotification is a “voice message”, and a “voice message” is output formessage display. When the location is “on train”, and the action is“stand”, the incoming call notification is done by “vibration”, andmessage display is done by “text display on a wrist watch type display105”. When the location is “on train”, and the behavior is “sit”, theincoming call notification is done by “vibration”, and message displayis done by “display 104”. When the location is “indoor”, and the actionis “-(arbitrary)”, the incoming call notification is done by“vibration”, and message display is “not performed”.

If notification is to be executed in several steps, for example, theuser is notified of only an incoming call by a voice message, and todisplay the contents as text, the user is notified of the medium ordevice where the details are to be displayed by a voice message.

When the notification is displayed on the display, and the use selects,e.g., “situation notification” (step ST1 in FIG. 20), the CPU 1012 ofthe main module 101 creates and displays notification text “I'm on theToyoko Line between Jiyugaoka and Toritsu-daigaku. Will arrive atShibuya in about 10 minutes” on the basis of situation information (stepST3 in FIG. 20). When the user checks the text and selects “transmit”,the text is converted in accordance with the medium and transmitted tothe caller (steps ST4 and ST5 in FIG. 20).

On the other hand, if the user selects “edit” in step ST3 of FIG. 20, amode for editing the situation information is set (step ST6 in FIG. 20).In the edit mode, for example, “Jiyugaoka-Toritsu-daigaku” in the aboveexample can be changed by the user to, e.g., “Nakameguro-Daikanyama”(step ST7 in FIG. 20). In accordance with this change, the CPU 1012 ofthe main module 101 automatically changes the message “10 minutes” asthe required time for “Jiyugaoka-Toritsu-daigaku” to “5 minutes” as therequired time for “Nakameguro-Daikanyama” (step ST8 in FIG. 20). Thiscan be easily implemented by preparing a section required time table inadvance, and when the section is changed in the edit mode, obtaining acorresponding required time by looking up the table.

When “replace” is selected in step ST3, the flow advances to step ST9 inFIG. 20 to allow whole message replacement, so any situation can be set.In this state, when, e.g., “in meeting” is selected (step ST10 in FIG.20), text that represents that the user is in a meeting in the officecan be created independently of the actual situation (steps ST10 andST12 in FIG. 20). When the user checks the text and selects “transmit”,the text is converted in accordance with the medium and transmitted tothe caller the user does not select “situation notification” in stepST1, a normal automatic answering telephone service is executed (ST2).

The edit contents are changed in accordance with the user's situationand detectable range. For example, if “in meeting” is selected, thecaller is notified of the time of end of meeting (the time of meeting isdetected from the schedule).

When such edit operation cannot be performed because of the user'ssituation, the user is inquired by voice, or an answer is automaticallysent in accordance with the conditions set in the table in advance.

As described above, the life support apparatus according to the thirdembodiment uses a wearable computer which has a BLUETOOTH™ as ashort-distance radio communication device and also has a function ofcollecting vital information and behavior information, and can hold theuser's schedule information and recognize the behavior state from thatinformation. This apparatus grasps the behavior state of the user, andupon reception of an incoming call at the handyphone or the like,selects an optimum method of dealing with the incoming call from thecurrent behavior state of the user. Even when an incoming call isdetected on the train or during meeting, an optimum response method forthat situation is automatically selected. For this reason, the user canrespond to the caller without troubling those around the user. Hence,the user can optimally cope with termination of a call or mail withoutany stress.

Especially, for the conventional “manner” mode of a handyphone, whenthat the user cannot respond to the call can be presented to the callertogether with the current situation, the caller can call the user againat a timing convenient for the user. This can be implemented by thethird embodiment. In addition, an essential conflict of the conventionalhandyphone, i.e., the callee must answer the phone to explain thathe/she cannot speak right now can be solved.

Various embodiments have been described above. In the embodiments of thepresent invention, information is presented to the user by voicesynthesis. However, the present invention is not limited to this, andcharacters or image may be displayed on a head-mounted display (goggletype display), pendant-type display, or wrist watch type display. Awrist watch type display or handyphone may incorporate a vibrator. Whena message for the user is received, the user may be notified ofreception of the message by actuating the vibrator.

The feedback medium may be changed in accordance with the user'ssituation on the basis of the measured and recognized behavior. Forexample, when the user is walking, a voice message is output. Duringwork, the message is displayed on the display window. When the user issleeping, no message is output, though in case of emergency, those whoare around the user are notified of the emergency as well as the user,or a message is transmitted to the family physician or security agent.In addition, the user may be notified of the emergency by strongvibration or voice to make him/her recognize the emergency level of theinformation.

When a state that the user cannot deal with is detected (when the user'sdisease is serious), a plurality of terminals in the neighborhood arenotified of that state. In this case, many people in the neighborhoodcan recognize the emergency, and a system capable of quickly coping withemergency in the aged society or single aged household can be built. Itis also useful to convert a message in accordance with the terminal totransmit information as to who is originating the emergency message andthe place of origination, or to set emergency levels and, as theemergency level rises, alarm in a large volume.

If the user himself/herself must measure data (e.g., when automaticmeasurement or data transfer is impossible), a message for prompting theuser to measure data is displayed in accordance with the measurementschedule. When no measurement is done, a follow message is periodicallydisplayed. With this arrangement, the system can be prevented fromirregularly functioning for a long time because no measurement result isobtained. The manner the message is displayed is preferablyinteractively adjusted.

In the above-described embodiments, the BLUETOOTH™ is used forcommunication between modules, though any other method can be used aslong as communication at personal level is possible. A technique (PAN:Personal Area Network) of using a body as a conductor and exchanging anelectrical signal has also been developed. Communication between modulesmay be executed using this technique. IrDA (infrared communicationinterface) can also be used. In the embodiments, communication betweenmodules is executed as radio communication. However, cable connectionmay be performed using, e.g., RS232C as one of standard interfaces forserial communication.

As the transfer condition, pieces of vital information before and aftera change in action may be transferred, the transfer rate may be raised(the priority level may be increased), or time resolving power may beincreased. For example, when it is determined that the degree ofphysical action is high on the basis of the output from the accelerationsensor, or for a behavior for which considerable stress is expected bythe above-described stress detection algorithm, the time resolving powerfor data to be measured is increased, and otherwise, the data aretransferred at a low resolving power. The type of acquired informationmay be controlled. For example, an electrocardiogram is acquired in ahigh load state, and only a pulse rate is acquired in a low load state.

In an arrangement in which the sensor modules and main module haveattached sensors, respectively, and sensors for acquiring the same dataare also prepared on the environment side, wearable sensor modules maybe used to acquire data when the sensors are attached, and the sensorson the environment side may be used to acquire data when the sensors aredetached.

To implement this system, e.g., an energization type attached/detachedstatus detection sensor in a sensor module is attached to the user. Ifthe sensor is a potential or resistance detection sensor, that thesensor is detached is detected when the resistance is infinite or theelectrodes are open, or a check signal is transmitted from the mainmodule to repeat detection. That the sensor is detached is detected whenno check signal is received. If the sensor is detached, the main modulesearches for a sensor capable of acquiring vital information andenvironmental information of the user from the environmental network,and if a sensor is found, the main module connects to the sensor toacquire data. If no sensor is found, a message “no sensor” is presentedto the user and recorded in data together with the reason. For, e.g.,the pulse sensor, when the user is taking a bath, the data is switchedto the pulse rate from the electrocardiogram obtained while the user isin the bathtub. When the user is sleeping, data is received as anelectrocardiogram from an electrode attached to the bedclothes, or avariation is detected by variation in breath (detected from an image).

In measuring on the environment side, if the communication state withthe wearable device degrades, data are stored on the network side. Whenthe connection state recovers, the data are transmitted to the wearabledevice. However, if an emergency occurs for the user, an alarm isdirectly output.

In the embodiments, measurement data is A/D-converted, and the situationis determined on the basis of a digital signal. However, this processingmay be executed using an analog signal.

As described above, according to the present invention, it is an objectof the present invention to provide a life support apparatus and methodwhich can determine the stress situation in daily life and notify a userof it to cause the user to realize the stress or can support the user ofa method of eliminating stress or care against the factor that hascaused the stress, on the basis of the situation of the user.

Also, it is an object of the present invention to provide a life supportapparatus and method which can determine the stress situation in dailylife and, on the basis of the situation, provide a user optimum serviceinformation for stress elimination or care on the basis of the situationin consideration of specific time and circumstances, and prompt the userto use the service information, thereby contributing to the commercialeffect and healthcare of the user.

Today, handyphones and the like show wide proliferation, and such aportable type communication device is one of necessary articles that aperson cannot dispense with because of convenience that allows contactand communication anytime and anywhere. However, an incoming call atsuch a portable type communication device may trouble those around theuser depending on user's situation, so the user must cope with theincoming call with constraint. This causes stress on the user, andtherefore, must be solved.

Further, it is an object of the present invention to provide a lifesupport apparatus and method which allow a user to select an optimummethod of dealing with an incoming call at a handyphone or the like onthe basis of the current behavior of the user, and also allow the userto automatically select an optimum method of responding to an incomingcall even in a train or during meeting, thereby making it possible tooptimally cope with an incoming call without troubling those around theuser and also preventing the user from allowing stress to build up in.

As has been described above, according to the present invention, in awearable type life support apparatus, the degree of stress is graspedwithout troubling the user on the basis of actual user's behaviorhistory and vital information in accordance with the motion informationmeasured from the user and schedule data, thereby navigating user's lifein a desired direction, e.g., relaxing the stress or making it possibleto perform operation at the maximum efficiency. When the pieces ofinformation are collected in units of regions, they can be used formarketing in each region.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. A life support apparatus comprising: a vitalinformation sensor adapted to be attached to a body to acquire vitalinformation of a user; a behavior information sensor adapted to beattached to the body to acquire behavior information of the user; asituation recognition device configured to recognize a user's situationbased on the behavior information acquired by said behavior informationsensor and the vital information acquired by said vital informationsensor to generate user's situation information; a data base configuredto store stress management information prepared in advance; aninformation search device configured to search said data base for stressmanagement information corresponding to the user's situationinformation; an information presentation device configured to presentthe stress management information obtained by said information searchdevice to the user; a measurement condition control device configured tocontrol a measurement condition of said vital information sensor inaccordance with the user's situation recognized by said situationrecognition device; and a setting device configured to set presentationcontents and procedure to be presented as the stress managementinformation to said information presentation device, and wherein saidinformation search device searches for relaxation information foreliminating stress and navigation information for controlling stress andincreasing an operation efficiency, and said information presentationdevice offers an information providing service for providing therelaxation information and navigation information in accordance with theuser's situation and the presentation contents and procedure set by saidsetting device.
 2. An apparatus according to claim 1, wherein saidinformation search device generates the stress management informationuseful for improving the user's situation recognized by said situationrecognition device.
 3. An apparatus according to claim 2, which furthercomprises a setting device configured to set presentation contents andprocedure to be presented to said information presentation device, andwherein said information search device searches for relaxationinformation for eliminating stress and navigation information forcontrolling the stress and increasing an operation efficiency, and saidinformation presentation device offers an information providing servicefor providing the information obtained by said information searchdevice, in accordance with the user's situation and the presentationcontents and procedure set by said setting device.
 4. An apparatusaccording to claim 3, wherein said information presentation deviceprovides information of a schedule and task of the user.
 5. An apparatusaccording to claim 3, wherein said information presentation devicepresents a fluctuation of a sympathetic and parasympathetic nature.